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Abstract — The peeling decoder introduced by Luby, et al. 
allows analysis of LDPC decoding for the binary erasure channel 
(BEC). For irregular ensembles, they analyze the decoder state 
as a Markov process and present a solution to the differential 
equations describing the process mean. Multi-edge type (MET) 
ensembles allow greater precision through specifying graph 
connectivity. We generalize the the peeling decoder for MET 
ensembles and derive analogous differential equations. We offer 
a new change of variables and solution to the node fraction 
evolutions in the general (MET) case. This result is preparatory 
to investigating finite-length ensemble behavior. 

Index Terms — peeling decoder, multi-edge type (MET) ensem- 
bles, binary erasure channel (BEC), low-density parity-check 
(LDPC) codes 

I. Introduction 

Low-density parity-check codes (LDPC) offer excellent 
channel coding performance using a simple decoding algo- 
rithm [1], Luby, et al. [2] introduced the peeling decoder 
as a tool for analyzing irregular ensembles over the binary 
erasure channel (BEC). With this tool they obtain a form of 
density evolution and conditions to determine threshold, the 
asymptotic limit of the ensemble decoding performance. 

Multi-edge type (MET) LDPC ensembles [3] generalize ir- 
regular ensembles by allowing control over graph connectivity. 
In particular, the MET framework allows for degree- 1 variable 
nodes, punctured variable nodes, and control over the graph 
structure that offer superior performance relative to irregular 
ensembles of comparable complexity (block length, average 
and maximum degree). In addition, MET ensembles are useful 
analytically as they include ensembles with interesting struc- 
ture such as repeat-accumulate, irregular repeat-accumulate, 
and protograph codes as special cases — as well as regular and 
irregular ensembles. 

In this paper we generalize the peeling decoder analysis 
to multi-edge type ensembles. Specifically, we present the 
modified difference equations and corresponding differential 
equations, introduce a new change of variables, and solve the 
system. The original MET analysis [3] treats belief propa- 
gation for the larger class of symmetric binary, memoryless, 
symmetric channels. However, the Markov chain setting is 
more easily applied to finite-length performance scaling [4]. 
We plan to build on this result to develop finite-length scaling 
laws for MET ensembles over the BEC and eventually for 
general channels as in [5]. 

This work was supported in part by the National Science Foundation under 
grant number ECCS 0636598. 



The remainder of the paper is organized as follows. Sec- 
tion [II] provides background on and notation for the peeling 
decoder and multi-edge type ensembles. Section III describes 
the system of difference and ordinary differential equations 
(ODEs) for the peeling decoder applied to MET ensembles. 



Section IV presents a new change of variables and the cor- 
responding ODE system solution. Section [V] discusses this 
solution and concludes the paper. 

II. Background 

A. Multi-edge type ensembles 

An MET ensemble [3] LDPC(iV, v,p) is specified by 
the transmitted block length N and a pair of multivariate 
generating functions, u(r, x) and /x(x) 
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type index (i.e. the subscript i on Xj) goes from 1 to n e while 
the channel type index (i.e. subscripts of n) goes from to 
n r in order to include the punctured channeQ ro. Each term 
(^b,dr b x d ) in v corresponds to variable nodes of a single type: 
the coefficient v\,& is the fraction of nodes of type (b,d), 
the exponent (pi) on each channel type variable (rj indicates 
the number of connections to that channej^] and the exponent 
(dj) on each edge type variable (xj) indicates the number of 
sockets of that type. The corresponding definitions hold for the 
coefficients /id and edge type exponents d of the terms of fi. In 
particular, note that variable nodes have type or degree (b, d) 
to distinguish their channel and edge connectivity while check 
nodes are distinguished solely by their edge connectivity, d. As 
with irregular ensembles, the ensemble consists of the codes 
corresponding to every (compatible) socket permutation. 

The remaining ensemble characteristics can be derived from 
these polynomials. The number of edges of type i connected 
to a particular variable node or check node type is given by 
NdiMb^ and NdifXd, respectively. Define 
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'Punctured data can be considered as transmitted through an erasure channel 
with erasure probability 1. 

"The channel type exponents b typically have a single non-zero entry of 
1 indicating that each bit receives exactly one channel realization. 
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Fig. 1. Peeling decoder operation. 



and the total number of edges of type i as 

Ei = Nv Xi {l,l) = Nfi Xi {l) 

and E = J^i Ei the total number of edges. The edge- 
perspective degree profiles are 

/ /^(x) Mg» j _(x) ' 

where the denominators can also expressed as Ei/N. 

B. Peeling decoder 

The peeling decoder of [2] attempts to recover an LDPC 
code word transmitted over the erasure channel. Its operation 
is depicted in Fig. [T] Given the channel realization (i.e. which 
bits were erased by the channel), each check node sums 
the known values from its attached variable nodes. Then 
the known variable nodes and their edges are deleted from 
the decoding (Tanner) graph since they convey no further 
information. The check node constraint allows us to deduce 
the value of a variable node connected to a check node with 
degree 1 in the remaining graph. Decoding proceeds iteratively 
on this principle. At each iteration T = 1,2,..., a degree- 1 
check node is selected at random. The attached variable node 
value is computed, then this node and the selected check node 
are deleted along with their edges. Decoding stops when no 
degree- 1 check nodes remain. If the remaining graph is empty, 
decoding was successful. Otherwise, the remaining variable 
nodes form a stopping set [6], [7]. The critical insight is 
that the distribution of socket permutations for the remaining 
graph at each iteration remains uniform, so the evolution of 
the degree sequence can be described as a Markov chain of 
degree distributions. 

III. Peeling decoder for MET ensembles 

Consider the operation of the peeling decoder on a code 
from an MET ensemble. This development closely follows [2]. 



However, we examine the evolution of node fractions instead 
of edge fractions: allowing multiple edge types results in a 
proliferation of redundant edge-perspective equations. 

Analyzing the peeling decoder for MET ensembles requires 
extending and adding notation. The node fractions are normal- 
ized by N while the edge fractions are normalized by E, so 
the average variable node degree d v — E/N and per-edge type 
average degrees d v ,i = Ei/N frequently appear as conversion 
factors. Let denote the unit vector with a 1 in position i 
and zeros elsewhere. By considering only the erasure channel, 
the vector of erasure probabilities e = (1, €\, €2, ■ ■ ■ ) can be 
substituted for the general distributions r. 

Consider the decoder state at time t = T/E. Define the time 
functions ^b.d(^) to indicate the remaining fraction (relative to 
N) of variable nodes of each type (b, d) at time t and similarly 
for check nodes. These time-varying parameters are not to 
be confused with i^.d and /i^, the fraction of nodes of each 
type in the Tanner graph before decoding. Denote 4,b,d(i) = 
d v diVb,d(t) the remaining fraction of edges (relative to E) of 
type i connected to variable nodes of type (b, d) at time t and 
r i,d(t) = dvdiPd{t) the analogous check node edge fraction. 
Summing either set gives 

ei(t) =5^4,b,d(t) =J2n,d(t), 

b,d d 

the remaining fraction of edges of type i at time t. Denote 
Nb,d(t) = ^V^b.d(^) the expected number of variable nodes 
of type (b,d) at time t and Md(t) = Np,d(t) the analogous 
check node mean. Let the time step At = 1 jE. Finally, denote 
the indicator function 



I{x} = 



1 if x is true 
otherwise. 



At each successful iteration, the peeling decoder deletes 
a check node of degree one, attached variable node, and 
their edges. For a code from a multi-edge type ensemble, 
there may be degree-one check nodes of several types from 
which to choose. Define the time-indexed sequence of random 



variables T(t) whose pmfs 7i(f) = P(r(£) = i) indicate 
the probability of choosing a degree-e; check node at each 
iteration. Interestingly, T(t) presents a free variable for the 
decoder of n t — 1 dimensions at each iteration. Choosing T(t) 
is discussed in Section M Assuming the decoder chooses a 
degree- 1 check node (CN) of type i, the probability that the 
attached variable node (VN) has type (b, d) is 

4b,d(i) d v div b ^(t) 



ei(t) ei{t) 

This value times 7i(t) gives the (joint) probability of choosing 
an edge of type i attached to a variable node of type (b, d). 
Hence the marginal 
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gives the total probability of removing a variable node of type 
(b, d) at time t. The difference in the expected number of 
nodes of each type is 



N hA {t + At) - N b , d (t) = -2-u hA {t) ^ ^7^- 



(1) 



Having selected a degree-e^ check node attached to a 
variable node of type (b, d), the decoder removes these nodes 
and their edges from the graph. Removing the variable node's 
edges changes the degree or type of the connected check 
nodes. One edge connects to the original degree-1 check node, 
but we need to account for the other d— e, edges. The expected 
number of "other" edges of type j deleted iq 
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is the expected (total) number of edges of type j deleted at 
time t. Assume each "other" edge is connected to an unique 
check node since the computation graph is tree-like in the 
large block length limit. The probability that a deleted variable 
node edge of type j is connected to a check node of type d is 
r j,d(t)/ e j(t) = djfid(t)/[d v ej(t)]. Deleting an edge of type 
j from a check node of type d + ej removes one node of this 
type and adds a node of type d. So the expected number of 
added check nodes of type d is 

(dj + l)nd+ Bj (t) 
d v ej(t) 



"In the first expression, the number of other edges, dj — I{i = j}, may go 



negative. However, this is not a concern since this only happens when dj 
so 4 b d (t) is zero. 







and the expected number of removed check nodes of type d 



7i(t)J{d is degree-1} 
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The expected change in the number of check nodes of type d 
is simply their difference, 
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7i(t)/{d = ej. 
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The system of difference equations given by ([T} and ([3]) 
describe the evolution of the expected number of variable and 
check nodes of each type. These quantities also provide the 
transition probabilities for the Markov chain whose state is 
these node counts. Since the time axis t is scaled inversely with 
E, in the large block length limit At — > and the discrete-time 
Markov chain approaches a continuous-time Markov process 
(see [4] for a formal description). The transition rates for 
this process are the limits of the corresponding difference 
equations. Since N^^t) = Nv\, d (t) — Ev bd {t)/d v — 
Ub id /(d v At), the limiting variable node rates are 



-*4i,d(*) = -vb,d{t) 
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Similarly, the check node fractions follow 
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dt 
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A. Initial conditions 



A complete solution requires the process initial conditions 
as well. The known nodes are deleted after the channel 
realization, so variable nodes attached to channel type k are 
retained with probability e^. Accordingly, the initial means are 



^b,d(0) = e b ^b,d- 



(6) 



In other words, each variable node is deleted from the remain- 
ing graph according to the probability that it is not erased over 
its attached channel. 

The check node fractions are more interesting. The proba- 
bility that an edge of type i is retained before the first iteration 
is 



Eb,d ^b.d 



Ei/N 



Ai(e,l), 



the weighted average of the probabilities that the variable 
nodes attached to this edge type will be retained. A check 



node type may be produced by deleting edges from any initial 
check node type with larger degree, so 

MO) = $>d (j) A(e, l) d [1 - A(e, 1)] a ~ d (7) 

d>d 

where d > d when di > di for i = 1, . . . , n t and the vector 
binomial denotes the product of binomial coefficients, 



n 



d, 



Note that the only non-zero terms in |7]) are those with positive 
fractions in the original Tanner graph, {d : /it 3 > 0}. 

IV. Solution for MET peeling decoder evolution 

The ODE system solution for multi-edge types is similar to 
that for the single edge case. One key novelty is the change 
of variables from t to x = (xi, X2, ■ ■ ■ , x n , ) with x % defined 
implicitly by 

1i(t) l_ dx^ 
ei(t) Xi dt 

This substitution conflates time with choice of T(t). For clarity, 
we will refer to x and its elements without making either 
dependence explicit. Using this substitution, the variable node 
differential equation is 



(8) 



dt 

with solution 



— ^b,d(e,x) = z/b, d (e,x) — ■ 



^b.d(e,x) = v bA e x 



(9) 



including the initial condition |6) at x = 1. 

The more involved check node derivation is presented in 
Appendix | but we include the result for degree- 1 check nodes 
here. 

Lemma 1. The solution to the system d3), |7) for degree-1 
check nodes is given by 

/Lt ei (e,x) = v Xi (e,x)[xi -l + pi(l- A(e,x))]. (10) 

Note that this solution is equivalent to the the result from [2] 
for the single-edge case. 

V. Discussion of solution and x-space path 

Equation ( fT0| ) provides the fraction of degree-1 check nodes 
of each type for any choice of schedule, T(-). The node 
fraction solutions are defined over the entire space X = 
[0, l]" e , but the decoder behavior is modeled by these equa- 
tions evaluated over the path x(t) induced by the schedule. 
In particular, the natural choice is for the peeling decoder to 
select a degree-1 check node without respect to edge type, i.e. 
according to the proportion of remaining degree-1 nodes of 
that type: 



7i(e.x) 



M ei (e,x) 
£„-Me,(e,x)' 



This choice yields another system of differential equations for 
x(t) which we have not yet solved. 

For an ensemble with a single channel type (besides perhaps 
the punctured channel), define the schedule threshold for a 
particular schedule as 

ep = sup{e : ( x (i)) > V i = 1, . . . , n t and t G [0, t/)} 

where x(t) denotes the path induced by the schedule T and 
tf = i/(e,l)/d v is the expected decoder completion time. Also 
define the ensemble threshold as 

e* = max{ef }. 

In fact, the choice of schedule is not critical. A reasonable 
schedule always chooses an edge type with a positive fraction 
of degree-1 check nodes when one is available. For example, 
choosing Ji(t) = I{i = 0}1 is an unreasonable schedule for a 
two-edge type code since the decoder will fail when the supply 
of degree-ei check nodes is exhausted even though degree^ 
check nodes may be available. 

Lemma 2. Every reasonable schedule T has e£ = e*. In 
other words, every reasonable schedule achieves the ensemble 
threshold. 

Proof: Failure events on the BEC are given by stopping 
sets [7]. A reasonable schedule will fail only at a stopping 
set. Since no schedule can decode past the unique maximal 
stopping set, every reasonable schedule must yield the same 
(optimal) error pattern. 

By standard arguments [2], the behavior of codes from 
an MET ensemble concentrate in probability around the 
means |[9), ( flu) and ([16) as the block lengh increases. For 
e < e* , all of the degree-1 check node fractions remain positive 
with high probability until decoding succeeds (t = tf). 
Likewise for e > e* , the decoder fails with high probability. 

Below threshold (high probability of success), the differ- 
ential equations for x(<) can be integrated numerically as 
shown in Fig. [2] Above threshold, all the degree-1 check 
node fractions go to zero for some x(f), so the natural 
schedule probabilities 7^ (and hence the equations for x) are 
indeterminate (0/0). 

Appendix 

In this section we present a derivation of the solution to the 
differential equations describing the mean decoding trajectory 
for the peeling decoder operating on an MET ensemble. In 
the sequel, we denote 7, as a function of x (time) and e in 
accordance with Section [V] where the choice of T depends on 
time (through x) and e. Consider the fraction of check nodes 
of degree greater than one. Denoting 
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the expected number of "other" edges deleted simplifies to 
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Fig. 2. Example of peeling decoder state evolution for repeat-accumulate 
ensemble, systematic bits punctured, rate 1/3. From [3], this ensemble has 
two edge types, f(r,x) = r\x\ + \^tqx\ and /i(x) = x\xi- These plots 
follow the natural path for e = 0.6175 ~ e*. The horizontal axis for both 
plots is x = XiEi/E, the weighted average of the elements of x. 



From the variable node solutions, the edge type fractions are 



e,;(e,x) = ^x^A^e, x). 



(12) 



Substituting these expressions into (151, the check node frac- 
tions follow 



dt 
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[-(dj + l)^d+ ej (e,x) +dj/x d (e,x)J— j- — r. (13) 

Similar to [2], the "explicit" solutions to ( fT3j ) are 

/^ d (e,x) = A(e,x) d 
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(inside the integral x is a function of r in place of i) which 
admit the solutions 



Md (e,x) = ^(-l)" d - d " c d A( e ,x) d . (15) 



d>d 



where ||d|| = Yli^i is the Li norm. Note that this sum 
ranges over all larger check node degrees with non-zero 
time-dependent fractions. The constants {cd} are determined 
recursively from the initial conditions as 

Md (e, x) = J2 Ma Q A ( e ' x ) d t 1 - A ( £ ' x )] ^ < 16 > 

d>d 

for check nodes of degree greater than one. This solution 
obviously satisfies the initial conditions and it can be 
shown that it also satisfies ( fl3] l. 

The fraction of degree- 1 check nodes is the difference 
between the total fraction of type-i edges and the fraction of 
type-i edges attached to higher-degree check nodes. 

^ 6l (e,x) = d„ej(e,x) - ^ d^ d (e,x) 

d#e; 

= d v ei(e,x) 

d#e s d>d V J 

= d„ei(e,x) 



EMdE^LW^H 1 -^*)] 

d d<d 

E Md(g. )A(e x) e [1-A(6.xi 

d>e, 



d-d 



(17) 



From definitions, the third term simplifies to 
d v ,iK(e, x)pi (l — A(e,x)). Furthermore, the second term is 

equal to ^a^a^^x) = <4,A( e > x )_= ^( e > x )0 
Combining these simplifications with d v ei(e,x) = 
d Vj iXi\i(e, x), we have the solution ( fTO) given in Lemma[T| 
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"Compare the generating functions (a + b) d and gS_ ( a _|_ b) d and 
their expansions with a = A(e, x) = 1 — b. 



